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Abstract 

The two-user Gaussian interference channel (GIC) has been extensively studied in the literature 
during the last four decades. The full characterization of the capacity region of the GIC is a long¬ 
standing open problem, except the case of strong or very strong interference. For general GlC’s, many 
inner bounds have been provided over the years, among of them, the Han-Kobayashi (HK) region, is 
the most celebrated one. Unfortunately, the calculation of the HK region is prohibitively complex, due 
to the appearance of some auxiliary random variables, whose optimal choice is an open problem. As 
in other multi-user communication systems, these achievable regions are based on ensembles of i.i.d. 
(memoryless) codewords, in the sense that the symbols within each codeword are drawn independently. In 
this paper, we show that for the GIC, it is worthwhile to employ random coding ensembles of codewords 
with memory. Specifically, we take known achievable regions for the GIC, and generalize/improve them 
by allowing dependency between the code symbols. For example, we improve the state-of-the-art HK 
region by drawing the codewords (of each codeword and for each user) from a first-order autoregressive 
moving average (ARMA) Gaussian process. In this way, we suggest several new achievable rate regions, 
which are easily calculable, and which are strictly better than state-of-the-art known achievable regions. 

Index Terms 
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Interference channel (IC), achievable rate region, bounds, capacity region, Han-Kobayashi region. 

I. Introduction 

The two-user interference channel (IC) models a general scenario of communication between two 
transmitters and two receivers (with no cooperation at either side), where each receiver decodes its 
intended message from an observed signal, which is interfered by the other user, and corrupted by 
channel noise. The information-theoretic analysis of this model has begun over more than four decades 
ago and has recently witnessed a resurgence of interest. In this paper, we focus on the two-user Gaussian 
interference channel (GIC), which has been extensively studied in the literature, see, for example, [1, Ch. 
6], [2], and many references therein. In the following, we describe briefly the two-user GIC model in its 
standard form, adopting to the notation in [3]. The discrete-time memory less GIC is defined as follows: 


Yl — Xl+ yj 012 X 2 + Z\, 

(la) 

Z 2 = \/a2\X\ P X 2 P Z 2 , 

(lb) 


where {Xi,X 2 ) and ( 1 ^ 1 , 12 ) the real-valued inputs and outputs, respectively, the cross-link gains 012 
and 021 are assumed time-invariant, and Zi and Z 2 are Gaussian random variables with zero mean and 
unit variance. We let X^ = (Xi 1 , Xi^ 2 , • • •, Xi,n) and Xf = (2^2,1,2^2,2, • • •, ^ 2 ,n) be two transmitted 
codewords across the channel, for each user, where Xij designates the symbol that is transmitted by user 
i G {1,2} at time instant j G {1, 2,... , n}. As usual, we assume that the receivers have full knowledge 
of the codebooks used by both users, and that there is no cooperation between the transmitters, and 
between the receivers. The following power constraints are imposed on the transmitted signals: 

n 

Y,nxlj)<nPi (2) 

1=1 

for i = 1,2, where Pi,P 2 > 0. It is assumed that the random vectors Zf and Zf have i.i.d. Gaussian 
entries with zero mean and unit variance, and they are independent of the inputs. Without loss of generality, 
we assume that Zf and Zf are independent, due to the fact that the capacity region of a two-user, discrete¬ 
time, memoryless IC depends only on the marginal probability density functions (pdfs) p{yi\xi,X 2 ) for 
ZG{1,2}. 

Despite of its simplicity, the problem of specifying a computable expression of the capacity region for 
the two-user GIC is still open, although it has been solved for some special cases of strong interference 
[4, 5], where 012,021 > 0, or very strong interference [6] where 012 > 1 -|- A and 021 > 1 -|- P 2 - 
Recently, however, the corner points of the capacity region were fully determined [7, 8], thus approving 
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Costa’s conjecture [9, 10]. The study of the memoryless 1C started in [11], and continued in [12], where 
the capacity region of a general discrete memoryless 1C was expressed hy a limiting expression (multi¬ 
letter formula) which, unfortunately, does not lend itself to a computable expression. Fundamental simple 
inner and outer hounds to the capacity region were also determined. In [13] an improved achievable rate 
region was derived, by using the well-known superposition coding technique. Various inner and outer 
bounds were established in [14] by transforming the original problem to some associated multiple access 
or broadcast channel settings. In their important work, Han and Kobayashi (HK) [4] have derived an 
inner bound for a general discrete memoryless 1C. It includes the achievable regions that were earlier 
established, and it is still the best known inner bound. Unfortunately, the computation of the HK achievable 
region is prohibitively complex, due to the appearance of some auxiliary random variables, whose optimal 
choice is an open problem. A simplified description of the HK region for the 1C was derived in [15]. 
Finally, in [3], another achievable region was derived, based on a modified time (or frequency) division 
multiplexing approach, originated in [14]. The suggested region is easily calculable, though it is a special 
case of the celebrated HK region. For a comprehensive survey paper on the 1C, see [16]. 

Recently, in [17] the sub-optimality of the HK region was demonstrated numerically on the clean Z- 
interference (ZIC) channel with binary inputs and outputs. In Section 2.2 of the same paper, the authors 
provided some intuition, based on their findings, why i.i.d. coding (in the sense of HK) might not be 
optimal for the 1C. Their intuition was based on the observation that X 2 acts like a state variable on 
the communication of the channel between Xi and Yi. Now if the channel from Xi to Yi, with X 2 
as the state, is not memoryless, we know that the optimal code distributions Xf are not independent 
distributions. Moreover, for the GIC, it is reasonable to believe that if the users will transmit on different 
frequency bands (or, for example, employ orthogonal signals), then there will be an improvement in the 
performance. These intuitions raise the following question: 

Question Can we improve known achievable rate regions by allowing dependency between the compo¬ 
nents, within each codeword of each user, rather than using memoryless (i.i.d.) distributions? 

The problem is that when the channel is discrete (in amplitude), it is extremely difficult to answer these 
questions. For example, assume that the codewords are drawn uniformly from a given Markov type. Then, 
analyzing the probability of error (associated for example with the joint typicality decoder) would require 
the calculation of entropy rates of certain hidden Markov processes, which is a well-known open problem 
on its own right. Fortunately, for GlC’s, this task is easier, because asymptotic mutual information rates 
have compact expressions in terms of the relevant spectra. 

Motivated by these observations, in this paper, we derive several new calculable achievable rate regions 
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(some of them are based on known achievable regions), where contrary to all other previous works, we 
allow dependency between the components within each codeword. Specifically, we start with a general 
coding theorem, which modifies the region proposed in [3], by employing codewords sampled from 
processes of a general spectral density (subject to the power constraint), namely, the codewords are 
drawn from a general stationary Gaussian process, rather than standard i.i.d. random coding. Then, we 
consider a simple special case of a first-order* autoregressive moving average (ARMA) process. We 
show that this choice can significantly improve on the region proposed in [3], and in particular, on its 
corner points. Then, we consider more sophisticated encoding/decoding schemes that are based on the 
HK scheme, and propose two new simple and calculable inner bounds that considerably improve the 
aforementioned regions, and improve state-of-the-art sub-regions deduced from the HK inner bound. 

The paper is organized as follows. In Section II, we formalize the problem and assert the main theorems. 
Specifically, in Subsection II-A, we modify Sato’s and Sason’s schemes by employing codewords of a 
general spectral density. Then, to demonstrate the improvement in using such schemes, we analyze the 
case of first-order ARMA process. We provide some numerical examples, and show that the new rate 
regions significantly improve on Sato’s and Sason’s results. Then, in Subsection II-B, we consider schemes 
that are based on the HK scheme, and derive new achievable regions. As before, we provide numerical 
examples which demonstrate the improvement compared to other known results. Finally, Section III is 
devoted to our main conclusions, and we also outline some possible extensions. 

H. Main Results 

In this section, we present our main results and then discuss them. We first establish some notation 
conventions. 

In our model, each sender, k G {1,2}, wishes to communicate an independent message Mk G 
{l, 2,... , 2”^'“} at rate and each receiver, I G {1,2}, wishes to decode its respective message. 
Specifically, a (2”^^^, 2”^^, n) code Cn consists of: 

• Two message sets Adi = {O,..., 2”^^ — l} and M -2 — {O,..., 2”^^ — l} for the first and second 
users, respectively. 

• Two encoders, where for each k G {1,2}, the k-th encoder assigns a codeword to each message 
i G Aik- 

• Two decoders, where each decoder I G {1,2} assigns an estimate Mi to M;. 

*By “first-order”, we mean one AR parameter and one MA parameter (i.e., one pole and one zero). 
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We assume that the message pair {Mi, M 2 ) is uniformly distrihuted over Adi x M. 2 - For a coded 
information of block length n, the two-user memory less IC is denoted hy: 


(A- X X y^) 


(3) 


where 

n 

y2\xi, X 2 ) = P{yi,k,y2,k\xi,k, X2,k), (4) 

k=l 

and in our GIC case P{yi^k 7 y 2 ,k\xi^kTX 2 ^k) is derived from (1). Since there is no cooperation between 
the two receivers, the average probabilities of error are 

pin) ^ ^-niR^+R,) ^ p (yn) ^ M 2 = m 2 } , i = 1, 2. (5) 

mi ,1712 

A rate pair (iii,i? 2 ) is said to be achievable if there exists a sequence of , 1^2"^^^] ,n) codes, 

such that Pg 1 0 and 2 0> ^s n —)■ 00 . The rates are expressed here in terms of bits per channel 

use. The capacity region of an IC is defined as the closure of the set of all its achievable rate pairs. 

As mentioned in the introduction, previous works on the IC focused mainly on standard random coding, 
where each codeword is independently and identically generated according to some given probability 
distribution. However, motivated by the above-mentioned interesting observation of [18], it is desirable 
to analyze other ensembles with possible dependency between the components of each codeword. 

In Subsection II-A below, we derive a new achievable region which is based on Sato’s and Sason’s 
schemes [3, 14]. Then, in Subsection II-B, we derive inner bounds which are based on the HK scheme 
[4]. 


A. Sato-Sason-based inner bound: 

In [14, Theorem 5], it was shown that the following rate-region is achievable: 

Gb = conv {Gbi U GB 2 } 

where conv{-} denotes the convex closure of a set, and where 


and 


Gbi = conv [J 

Pxi ,Px2 




0 < Ri < I{Xi;Yi\X2) 

0 < P 2 < min{/(A2;yi),/(X2;y2)} 


Gb 2 - conv y 

Pxi ,Px2 


{ {Ri,R2) 


0 < Pi < min{/(Ai;yi),/(Xi;y2)} 

0<P2</(A2;y2|Ai) 


( 6 ) 


(7) 


( 8 ) 
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This achievable region is interpreted as follows: the first region, Qbi, refers to the mode of work where 
receiver 1 first decodes the message of the second sender, and then uses it as side information for decoding 
his own message. Receiver 2 directly decodes his message based on his received signal. The second region, 
Qb 2 ^ refers to the opposite mode of work, where the roles of receiver 1 and 2 are interchanged. Sason’s 
scheme [3] is based on the above region. His idea was to employ the first mode for a fraction A of the 
transmission time, and the second mode for the complementary time. Let us define generically, z = 1 — z 
for z G [0,1], and rj{x) = 0.5 log 2 (l+ a:) for x > 0. The following fheorem stales an achievability result. 


Theorem 1 ([3, Th. 1]) The set of rate pairs: 

Ri ^ A 

{Ri,R2) : 


^sason — 

o,/3,Ae[0,l] 


< A • r? + A 


• mm • 



(9) 


is achievable for the two-user GIC in (1) under the power constraints (2). 


In order to obtain the above region, Sason [14] employed a random coding approach, in which 
the codewords are selected in a memoryless manner, that is, they are drawn independently from a 
given probability distribution. Since in our coding scheme there will be dependency between the 
components of each codeword, the above single-letter expression will no longer be suitable. Let 

square summable, non-negative definite sequences^ 
with rii^o = '^ 12,0 = ?’ 2 i,o = '^ 22,0 = 1- Let a,l3,XG [0,1], and define: 

unioj) = 2 X] cos , (10a) 


U2l{u!) = 

ouiuj) = 
J^22(w) = 


A m 

A 

aPi 

m 

A 


1 + 2 r 2 i^k cos {kuj) 
\ k=l 

^ 00 

1 + 2 ^ ri 2 ,k cos {koj) 


k=l 

00 


1 + 2 ^ r 22 ,fc cos {kuj) 


k=l 


where oj G [0, 27r). Finally, we define fhe functional: 

1 

+ [/] = ^ Jo 


(10b) 

(10c) 

(lOd) 


( 11 ) 


sequence is called non-negative definite if for any n > 1, the Toeplitz matrix, that is gen¬ 
erated by L non-negative definite. Equivalently, is non-negative definite if the spectral density 

X]^-cx> L non-negative for any oj £ [0,27r]. If ak ~ a-k for fe > 1, then the sequence is non¬ 
negative definite if cos{kuj) is non-negative for any lo € [0, 27 r]. 
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Let e = (a,^,A,{rii,i}.>^,{ri 2 ,i}j>i,{r 2 i,i}.>^,{r 22 ,i}j>i) G 0, where 0 is the support of 6 , as 
defined above. The following theorem is proved in Appendix A. 


Theorem 2 The set of rate pairs: 



Ri < X ■ tp + A • min < 

[t 

1212 

R= U < 

^A-a^nV-,n 

iRi,R2): 

r 

L ' 


6»e© 

R 2 < X - if [ 1222 ] + X ■ min -j 


0^121^21 
. 1+^11 _ 

5 


is achievable for the two-user GIC in (1) under the power constraints (2). 








«21 ^^12 
l + i^22 

1^21 



( 12 ) 


Note that Theorem 2 is a generalization of Theorem 1. Indeed, in order to obtain Theorem 1, Sason 
employed the encoding and decoding schemes mentioned above (see discussion before Theorem 1), where 
during a fraction A of the transmission time, the symbols of a;i and X 2 are Gaussian with zero mean, 
and variances aPi/\ and / 3 P 2 /A, respectively. During the remaining fraction A of the transmission time, 
the symbols of xi and X 2 are Gaussian with zero mean, and variances aPi/\ and / 3 P 2 /A, respectively. 
To obtain Theorem 2, on the other hand, we employ the same encoding and decoding schemes, but we 
assume that the codewords (for each user and each mode), are drawn from stationary Gaussian processes, 
with zero mean, and Toeplitz covariance matrices with the elements {rn j} , {ri 2 ,i} , {r 2 i,i} and {r 22 ,i}, 
where = {aPi/X)~^E r 2 i,i = {/3P2/X)~^E{X2,raX2,ra+i}, for 1 < m + i < nX-1, 

and ri 2 ,i = (Ai^l/A) E and T 22 ,i — {^P 2 /X) ^ {X 2 ^m+n\^ 2 ,m+n\+i'}■ 

Theorem 2 is, of course, general and it requires a union over all combinations of user spectra (that 
satisfy the power constraint), so it is not calculable practically. To demonstrate the improvement of using 
codewords with memory, we propose the following special case (the complete details can be found in 
Appendix B). Consider the case where during a fraction A of the transmission time, the components of 
xi and X 2 are given by: 


Xi,i = + (TiWi^i - 7 = 1,2,..., nA - 1 (13a) 

X 2 ,i = 9 x^X 2 ,i-i + cr 2 W 2 ,i - K 2 cr 2 W 2 ,i-i, i = 1,2,. .. ,nX - 1 (13b) 


where, without essential loss of generality, we assume that nX is integer, and 


2 A ^ 


(Jh = 


1 + kA 2.KkPx 


(14) 


for k = 1,2 where \pxi \, l/O^al > l^il > l^ 2 | < xi^ and X 2 ,o are Gaussian random variables with zero 
means and variances aPi/X and I 3 P 2 /X, {wi^i} and {w 2 ,i} are i.i.d. Gaussian process with zero mean 
and variances aPi/X and I 3 P 2 /X, and 0 < a,/3 < 1. That is, the symbols of xi and X 2 are distributed 
according to sl first-order auto-regressive moving average (ARMA) model. Note that when ki = K 2 = 0, 
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we have a first-order Gaussian Markov process (AR process). During the remaining fraction A = 1 — A 
of the transmission time, the symbols of xi and X 2 are given hy: 

xi,i = px^xi^i-i + - Kiaiwi^i-i, i = nX-\- 1,... ,n (15a) 

X 2 ,i = Px 2 X 2 ,i-i + cr 2 W 2 ,i - K 2 cr 2 W 2 ,i-i, z = nA + 1,..., n (15h) 

where xi^nX and xi are Gaussian random variables with zero means and variances aPi/X and fiP 2 /X, 

respectively, wi^i and W 2 ,i are i.i.d. Gaussian process with zero means and variances aPi/X and fiP 2 /X. 

When Ki = K 2 = 0, it is evident that for z = 1,..., nA — 1, consecutive samples from xi and X 2 have 
correlations pxi and px 2 , respectively. This is also the case for z = rzA,..., n. The receiver, on the other 
hand, has the same two modes of work, as described earlier. Let: 


(1)/ \ A 

7i = 


a\aPi 1 — 


X\l-px,ei‘-\ 

(1)^ ^ A (xII5P2 |l - 

72 (w) =-- 


2 ’ 


X\l-px2e^^\ 


2 ’ 


(2)/ \ A 

7i = 


(2)/ N A 
72 (w) = 


cj^aPi 1 — Kie^‘" 


2 ’ 


al(3P2 |l - K2e^^ 


(16a) 

(16b) 

(16c) 

(16d) 


X\l-px2e^^\^ 

where u G [0, 27r), j = sTM, and define fi) = {a, /?, A, px^ , px 2 ,Ki, ^ 2 ), and 'J' = [0,1]^ x (—1,1)^. We 
have the following result, proved in Appendix B. 


Theorem 3 The set of rate pairs: 



/ 

R\<X-p 

'if 

+ A • min < p 

77^^) = U < 

(i?l, 7?2) 

V 

R 2 <X - p 


1 

+ A • min | p 


\ 



T 

a2i7p* 

Ll+ai272^^ J 

•) 


r ( 1 ) 1 


r 

(1) 1 

ai272 



72 I 

[ 1 + 7 }'* J 


Ll+a2i7}^G 


is achievable for the two-user GIG in (1) under the power constraints (2). 

Several remarks regarding Theorem 3 are in order: 

• The above analysis can be generalized to an ARMA process of any order, i.e.. 

Pi <?i 

Xi^i ^ ^ Ppx\X\^i—i T ^ ^ 


1=1 


1=1 


(17) 


(18) 


where the variance af should be chosen such that the Var{xi^i} = aPi/X for all 1 < z < An, and 
similarly for the second user. Then, we obtain the same result as before, but with: 


(1). X A <xlotPi |l 
7i (w) = 


j7a;|2 


A 1 - Ef=i Pix,ie- 


.jluj 


|2 ’ 


(19a) 
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(1)/ \ A 

72 = 


(2)^ N A 

7i (w) = 


(2)/ X A 
72 = 


I 


aj^Pi 1 - ^2,f& 

.TiQPl jl - J2 iLi 


ojZoj I 


^ |l - Y.iLiPix,ie- 

alpP2 |l - Ef=i«^2,«e-^'‘^| 


(19b) 

(19c) 

(19d) 


A|l-Ef=i/ 02 x,«eJ'‘^| 
where al is chosen such that Var{x 2 ,i} = / 3 P 2 /A for all W < i < n. 

• One can generalize the above results by using different parameters in the two segments. For example, 
for the first-order ARMA process, instead of keeping the same parameters px^ and ki within the whole 
codeword xi, we can conjugate the parameters pix-^ and kh for z = 1 ,... ,nA, and a correlation of 

parameters p 2 xi and K 21 for z = nA + 1,..., n. Accordingly, one would obtain the same result as before, 

ik) 

but replacing every instance of 7 E for z, A: = 1,2 with: 


(1)/ X A o-nO-Pi |l - Kiie- 

7i (w) =- 


A|1 


(1). X A 0-?2/3^2 |l - Kl2e^‘^ 

2 M = -TT- 


72 

(2)/ X A 

71 (w) = 

(2)/ X A 

72 {^) = 


A|l-pi,,e^-| 


^ 0-21 aPi 1 - K2ie- 


3^\ 


\\1-P2x,ei^\ 
al2^P2 11 - K22e'^‘‘ 
A|l-P2x.ef-|" 


(20a) 

(20b) 

(20c) 

(20d) 


where 


^2 A 
^kl — 


1 - pIx, 


(21) 

and we take the union over all possible allocations of {pkxn ^^ki} for k, I £ {1,2}. Numerical calculations 
demonstrate that in some cases, this generalization improves the achievable region. 

• The capacity region of a discrete memory less 1C was expressed in [12] by the following limiting 
expression: 


i?i<i/(Xf;yf)] 

(i?i,i?2): > (22) 

R2<^I{X^;Y2^)\ 

where limit superior of a sequence of sets, {An}, is defined as lim sup„_j.oo l^n>N An- 

Accordingly, it is tempting to compare the achievable region resulting from (22), when restricting the 
input distribution to Gaussian ARMA processes. When doing so, numerical examples show that our 
proposed achievable region is better. 


Cic = lim sup conv 


PS, P: 


^2 
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• The various integrals in (17) can actually be calculated by using Cauchy’s integral formula, which 
implies that /Q^’^log 2 (l + dw = 0, whenever |C| < 1- For example, for ki = K 2 = 0, we get: 


where 






1 

dvr 

1 


(‘2 'k 


log 2 (l + 7r^(w)) do; 


(‘2'k 


= \ log 2 


A Pxi 


iT- |l-Ce^'“ 


^ A X 




2pxi 


4p: 


- 1 , 


Xi 


X — 1 + /^Xi + 


(1 - PxJq-Pi 

A 


dcu 


(23) 

(24) 

(25) 

(26a) 

(26b) 

(26c) 


Unfortunately, the formulas of the other integrals are more complicated, and thus we keep the above 
integral representations. 

In the following, we provide a numerical example which illustrates the improvement compared to [3]. 
First, note that by construction, TT-sason ^ 77^). Fig. 1 presents a typical comparison between: 77.sason> 
TT-d), which is the region 77^) when fixing ki = ^2 = 0 (an AR process), and 77[J^ which is the 
region when fixing = Px 2 = 0 MA process), for Pi = 6, P 2 = l,ai 2 = 3, and 021 = 0.1. The 
numerical calculafions were carried ouf by an exhausfive search over a grid on fhe parameter space, wifh 
a sfep-size of 10“^. If is evident from the figure fhaf the new proposed regions (AR, MA, and ARMA) 
strictly include TT-sason- Also, it can be seen that there is a noticeable improvement when using ARMA 
input processes compared to AR input processes. The improvement compared to MA input processes is 
less significant. It is interesting, however, to check what are the ARMA parameters which achieve rates 
that cannot be achieved by the other filters. Consider, for example, the pair (Pi,P 2 ) = (1.191,0.3909), 
which is marked by a small circle in Fig. 1. To achieve this point, one should choose: ki = 0.2605, 
K 2 = 0.9801, pxi = 0.7425, and = 0.4950. The moduli of the frequency responses of the filters of 


the two users, i.e.. 


1 _ ■ p 3^ 


(27) 


are presented in Fig. 2. It can be seen that the frequency responses for the two users tend to 
amplify/attenuate in different frequency regions (one of them is a low-pass filter, and the other is a 
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Fig. 1: Comparison between 7^sason^ (ARMA), when fixing ki = K 2 = 0 (AR), and when 
fixing = px^ =0 (MA), for Pi = 6, P 2 = 1, ai 2 = 3, and 021 = 0.1. 


high-pass filfer), which makes sense. 

Fig. 3 also illustrates the improvement compared to [3]. It presents a comparison between TZsn&on, 
and A = 6, P 2 = Ij 0^12 = 2, and 021 = 0, that is, a ZIC. It is evident that our region strictly 

includes that of [3]. Also, it can be seen that our upper comer point is greater than that of 7?.sason- Note, 
however, that one can show that the upper corner point of the capacity region, for the given setting, is 
given by [8]: 

C'l = max |i?i : ^ log 2 [1 -h G Cicj = 1.083, (28) 

which is larger than our values. This observation motivates us to consider more sophisticated encod¬ 
ing/decoding schemes, described in the following subsection. 

B. HK-based inner bound: 

In this subsection, we consider encoding/decoding schemes based on the Han-Kobayashi (HK) scheme 
[4], which will be briefly reviewed in fhe sequel. The idea is fo split the message Mi into “private” 
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Fig. 2: The modulus of the frequency response of the two users. 


and “common” messages, Mu and M 12 at rates Rn and R 12 , respectively, such that Ri = Rn + i?i 2 . 
Similarly, M 2 is split into two messages M 21 and M 22 , at rates R 21 and R 22 , respectively, such that 
R 2 = R 21 + R 22 - Then, receiver A: = 1, 2 recovers its intended message and the common message 
from the other sender (although it is not required to). This scheme is illustrated in Fig. 4. The intuition 
behind this splitting is based on the receiver’s behavior at low and high signal-to-noise ratios (SNRs). 
Specifically, it is well-known [1] that: (1) when the SNR is low, treating the interference as noise is 
an optimal strategy, and (2) when the SNR is high, decoding and then canceling the interference is the 
optimal strategy. Accordingly, the above splitting captures the general intermediate situation, where the 
first decoder, for example, is interested only in partial information from the second user, in addition to its 
own intended message. When i.i.d. random coding is employed, it was shown in [4] that the following 
rate region is achievable: 


Ri < Pi, R2 < P2, Ri + R2 < P12, 2i?i + R2 < piQ, Ri + 2 i ?2 < P20, (29) 
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Fig. 3: Comparison between 7?.sason^ (ARMA), and 7^^^^ when fixing ki = K 2 = 0 (AR), for 
Pi = 6, P 2 = 1 ,012 = 2, and 021 = 0. 


where: 

Pi = <jl + I{Yi-Ui\ViV2Q) (30) 

P2 = a2*+/(y2;C/2|^1^2Q) (31) 

P12 = ct *,2 + liYi; P 1 IV 1 V 2 Q) + I(Y 2 ; i72|^i^2Q) (32) 

Pio = 2 ct; + 2I(Yi; Ui\ViV 2 Q) + /(Ps; U 2 \ViV 2 Q) - K - /(Ps; Vi\V 2 Q)]^ 

+ min {I{Y2;V2\Vi,Q), I{Y2 ; ^2 1 Q) + [/(I2; Fi|^2^) - , 

+I{Yv,V2\VuQ),I{Yv,Vi,V 2\Q) - al} (33) 

P20 = 2a*2 + /(Pi; Pi|1^i1^2Q) + 2 /(^ 2 ; U2\ViV2Q) - [rr^ - I{Yr, f^2|^iQ)] + 

+ min {/(Pi; FiI^2, Q), I{Yi ; l^i |Q) + [/(^i; 1 ^ 2 , 

+ 7 (^ 2 ; 11^2, Q), I{Y2;V2,Vi\Q) - a*2} , (34) 
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Mil ^ Ui 


M \2 Vi 


M21 —> V2 


M22 U2 



Yi (Mil, Mi2,M21) 


y2 ^ {Mi2, M2\, M22) 


Fig. 4: Han-Kobayashi coding scheme. 


and 

al = uim{I{Yr,Vi\V 2 ,Q),I{Y 2 ;Vi\U 2 ,V 2 ,Q)} (35) 

= min {7(^2; 1^21^1, Q),/(n;^ 2 |C/i,V^i,Q)} (36) 

^ 1*2 = min {I{Yi■,Vi,V2\Q),IiY2-,Vi,V2\Q), I{Yi ; Fi| ^2 , Q) + /(I 2 ; ^2 1, Q), 

HY 2 ■,Vi\V2 ,Q) + I{Y^-,V2 \Vi,Q)} , (37) 

where Ui,U2,Vi, V2 are auxiliary random variables^, and Q is a time-sharing variable. 

Now, consider the GIC. As was mentioned before, evaluating the HK region for the Gaussian case, is 
prohibitively complex, due to the auxiliary random variables. Unfortunately, it is still unknown how to 
choose them optimally. A state-of-the-art common choice in the literature is the following: 

X, = Ui + Ui, Ui ~ N{0,CiPi), Ui ~ N{0,CiPi), (38a) 

X 2 = U 2 + U 2 , U 2 ~ N{0,^2P2), '^^2 ~ iV(0,e2^2), (38b) 

where Ui and Vi are statistically independent for i = 1,2, and ^ 1,^2 £ [0,1] are auxiliary parameters. 

In the spirit of the previous subsection, we next provide two achievable regions, which are based on 
a combination of the Sato and the HK schemes. The difference between these regions will be in their 
decoding techniques. Also, we emphasize that, as in the previous subsection, here too, one can obtain 
results for general Gaussian stationary processes. For simplicity of the demonstration, however, in order 
to keep a reasonable number of parameters to be optimized, we will confine ourselves to first-order 

^The intuition behind these auxiliaries is that the private messages are transmitted via Ui and U 2 , while the common 

messages are transmitted via Vi and V 2 . 
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Markov processes (first-order AR). Let us describe briefly the encoding technique. 

Encoding: As before, we consider two modes of work. At the first A fraction of the transmission time, 
the symbols of Xi are as in (13a), and we generate 2 ^^^ such independent codewords {xi{i)}. For 
the second user, however, we use rate-splitting technique, as was used in the HK scheme, and generate 
2 ni?( independent codewords {t; 2 (i)} and {u 2 {i)}, respectively, where 0 < i ?2 ^ ^2 and 

i ?2 = f ?2 — ^ 2 ’ following way: 


^2,i — Pu2^2,i—1 “h 
V2,i = Pv2V2,i-l + 



(39a) 

(39b) 


where \pu 2 \ , IPval < ^ 2,0 and r; 2 ,o are Gaussian random variables with zero mean and variance / 3 C 2 .P 2 /A 

and / 3 .^ 2 ^ 2 /A, respectively, and |m 2 j| and |m 2 j| are i.i.d. Gaussian processes with zero mean and 
variance /3C2^2/A, and /3^2P2/K respectively, where 0 < (3,^2 < 1- Then, the 2”^^ codewords {x 2 {i,j)} 
are given by the element-wise addition: 


X2{i,j) = U2{i) -h V2ij) (40) 

for t = 1, 2,... , 2”^2 and j = 1,2,..., 2’^^'^. Intuitively, the {r» 2 (t)} codewords serve as the common 
information to be decoded by both receivers, while {u 2 {i)} codewords are the private ones, to be decoded 
only by the second receiver. Finally, during the remaining fraction A = 1 — A of the transmission time, 
the roles of the encoders are swapped. Specifically, the symbols of X 2 are as in (15b). For xi, we use 
rate-splitting, and generate 2”^'i and 2”^” independent codewords {r»i(t)} and {rii(z)}, respectively. 
Then, the 2”^^ codewords {xi{i,j)} are given by: 

xi{i,j) = ui{i)+vi{j) (41) 

for i = 1, 2,... , 2’"^i and j = 1, 2,... , 2'^^'k 
Now, we consider two decoding techniques: 

Decoding itl - Successive cancellation decoding: 

• Mode #1: Receiver 1 first decodes the common message V 2 , and then uses it as side information for 
decoding xi. Receiver 2, on the other hand, decodes (simultaneously, as with the MAC) his messages 
V 2 and U 2 . This mode of work will be used a fraction A of the transmission time. 

• Mode #2: Receiver 2 first decodes the common message vi, and then uses it as side information for 
decoding X 2 . Receiver 1, decodes his messages vi and ui simultaneously. This mode of work will be 
used a fraction A of the transmission time. 
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Decoding #2 - Simultaneous decoding: 

• Mode #1: Receiver 1 decodes simultaneously the messages V 2 and xi. Similarly, receiver 2 decodes 
simultaneously V 2 and U 2 . This mode of work will he used a fraction A of the transmission time. 

• Mode #2: Receiver 2 decodes simultaneously the messages vi and X 2 . Similarly, receiver 1 decodes 
simultaneously tii and ui. This mode of work will he used a fraction A of the transmission time. 

The following theorems, which are proved in Appendix C, give the achievable rate regions resulting 
from the above encoding/decoding schemes. Let us first define the following functions: 


7x1 (w) = 
7x2 (w) = 
7«i(w) = 
Iv, (w) = 

= 

7X2 (w) = 

where w G [0,27r), \puA ,\Pv^\ ,\Pu 2 \ ,\Pv^\ 
(a, P, X,^1,^2 t Pxn Px2j Pun Pvi, Pu2j Pv2)-' “ 


(1- 

- pl^)aPx 

A|1 

-Px,e^^?' 

(1- 


A|1 

-Px2e^^\^' 

(1- 

pl,)ixdtPx 

A|1 

-Pxie3-|2 

(1- 

pl,)ixaPx 

A|1 

-/3xiel“|^ 

(1- 


A|1 

-/^X2el“|' 

(1- 



< 1, and ^ 1,^2 £ [O;!]- Finally, define 

^[0,l]''x (-1,1)6. 


(42a) 

(42b) 

(42c) 

(42d) 

(42e) 

(42f) 
^ = 


Theorem 4 (Decoding #1) The set of rate pairs: 


7^(2) = U \ 

4eH 


(i?l, i?2) : 


Rx<Rx{i) 

R2 < R2{^) 


(43) 


where 


RxU) = \-t 


7xi 

1 \ TTtlTt J //~) 

' 7xi + 7xi ’ 

1 + 

7x1 

1 / 

7xi 

_ 1 + 0127^2 . 

^ A. liilll N ^ 

. 1 + 0127x2 . 

. 1 + 0127x2. 

i- + 

. 1 + 0127x2. 


and 


R2{$) = X-P 


7X2 


1 + 0217mi 




+ A • min < (p 


<3217x1 


[1 + 7x2 + <3217X1 




7xi 


[1 + 0127x2] 


(44) 




7X2 + 7X2 

1 + 0217x1 J 

0127x2 




7X2 


+ + 


7X2 


1 +0217x1 J [1 + 0217x1 

7X2 


1 + 7xi + 0127x2 


+ + 


1 + 0217x1 J 


(45) 
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is achievable for the two-user GIC in (1) under the power constraints (2). 


Theorem 5 (Decoding #2) The set of rate pairs: 

R2<Mi) 


= [j ^ 


(46) 


where 


RiU) = \-T 


Ixi 


[ 1 + 0127^2 J 


+ A min ^ ip 

T 


iil + ii2 < -Rsum(^) J 

7ni + 71-1 


and 


R2{i) = \-ip 


lx -2 


[1 + 0217^1 J 


and 


R.nm{i) = \-{t 


+ A min | ip 
T 

7a-i 0.1271-2 


[1 + ai27a-2j 
Q217i;i 

I + 0217111 . 

7^2 + lvi 

[1 + 0217211 J 

01271-2 

.1 + Oi27«2 




+ p 




Ivi 


1 + Ol27ai2 J 

7iti 

1 + 0127x2 


+ p 


7«i 


1 + 0127 x 2 ] ’ 


(47) 


7X2 


+ p 


1 + 02l7aii J 

7«2 


+ p 


1U2 


1 + 0217x1 J ’ 


1 + 0217x1 


(48) 


1 + Ol27n2 


+ P 




+ A • ] (/9 


1 + 0217x1 
7X2 + 0217X1 


+ p 


1 + 0217mi 

is achievable for the two-user GIC in (1) under the power constraints (2). 


7xi 


1 + 0127x2 


(49) 


Finally, in view of Theorems 4 and 5, we obtain the following immediate result. 


Corollary 1 The rate region: 

= conv 1 77 ( 2 ) U I , (50) 

is achievable for the two-user GIC in (I) under the power constraints (2). 

One may realize that the above encoding scheme can be easily generalized by rate splitting both users 
in both segments, and not just one user in each segment, as we did above. This modification adds, 
of course, more parameters to be optimized. Nonetheless, numerical calculations show that there is no 
noticeable improvement due to this generalization. 

Given the above results, let us consider two numerical examples. First, we consider the same example 
as before, and see the improvement of the new achievable regions. Fig. 5 presents a comparison between 
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Fig. 5: Comparison between 7^sason> and for Pi = 6 ,P 2 = l,ai 2 = 2, and 021 = 0. 


"^sason^ and for Pi = 6 ,P 2 = l,ai 2 = 2, and 021 = 0. The improvement resulting from the 

new achievable regions is evident, where achieves the best results. Also, note that achieves the 
upper corner point of the capacity region, which is given in (28). Fig. 6 presents a comparison between 
Psason, P^^\ P’'^\ and Phk for Pi = 1 ,P 2 = 6,012 = 0.1, and 021 = 0.5. The region Phk is the 
(state-of-the-art) HK region given in (29) and (38). Here, Psason and P^^^ coincide. It can be seen that 
for this example Psason is in some regions better than PHK^ but not everywhere. The new region pi^i, 
however, uniformly outperforms Psason and Phk- 

III. Conclusion 

In this paper, we analyzed several encoding/decoding schemes for the two-user GIC. Usually, as in 
other multi-user communication systems, achievable rate regions for the GIC are based on ensembles of 
i.i.d. codewords. In this work, however, we analyzed the impact of using random coding ensembles of 
codewords with memory, and we show that it can noticeably improve known results which are based 
on ensembles of i.i.d. codewords. Specifically, we took known achievable rate regions for the GIC, and 
generalized them by allowing dependency between the code symbols. Numerical calculations show that 
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Fig. 6 : Comparison between 7?.sason, TZ^^\ and T^hk for Pi = 1,^2 = 6 ,ai 2 = 0.1, and 021 = 0.5. 


even for very simple memory structures, such as first-order MA process, the obtained achievable rate 
regions are wider than other known achievable rate regions, and in particular, the state-of-the-art HK 
region. 

The main difficulty with our approach, is the optimization required to obtain the achievable region. 
Indeed, recall that the optimization is over the filter coefficients (and the time sharing parameters), which 
may be as large as we wish, but at the expense of computational complexity. A possible simplification 
is to consider the same filters but with a large number of random coefficients (in the spirit of random 
coding), distributed according to some given prior distribution. Using this approach, we will end up with 
optimizing over only three parameters (a,/3,A), and we can use a large number of filter coefficients. 
Unfortunately, numerical calculations show that the above randomization approach significantly degrades 
the achievable regions resulting from the optimizations. Another possible approach is to use time-variant 
random filters. For example, = HiUi where Hi is an i.i.d. random matrix, and ui is an i.i.d. 
Gaussian random vector, and we choose the variance of ui to apply the power constraint within each 
segment. We do the same for X 2 . Using random matrix theory, an achievable rate region can be derived. 
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Unfortunately, again, numerical calculations show that this approach fails compared to the optimization 
over a relatively small number of parameters, as was carried out in the body of this work. 


Appendix A 
Proof of Theorem 2 


To prove Theorem 2, we will first generalize Sato’s result in (6)-(8), such that it will apply to any 
input distributions, and not just i.i.d.. To this end, we need to analyze the probability of error. We next 
show that a general achievable rate region, is given by: 


Gb = conv 


U Gb 2 ^ 


(A.l) 


where 


Gbi = liiii conv 

n—>-oo 


u 


pn pn 
^Xi 


(iil, i?2) : 


and 


Gb 2 — lim conv I I 

n^oo 


{Ri,R2) : 


0<i?i < 

0<R2< mm{^IiX^-Y{^), ^I{X^;Y^^)} 
0<Ri< mm{^I{X^-Y{^), ^I{X^;Y^^)} 


(A.2) 


(A.3) 


0 < R2 < ^I{X^;Y{^\X^) 

Let P^{xi) and P|^(a; 2 ) be arbitrary probability assignments on the two sets of channel input sequences 
xi and X 2 of length n. Select independently Mi and M 2 codewords xu, for f = 1, 2,..., Mi, and X 2 j, 
for f = 1,2,... ,M 2 , according to P”(a;i) and P|^(£C 2 ), respectively. We now describe the operation 
of the two decoders corresponding to the region Gbx- Assume that both decoders know the probability 
distributions Pi"(a;i) and ^^(* 2 ), and therefore know the following conditional probabilities. 


Pi{yi\^2) = '^Pi{yi\xi,X2)Pi{xi) (A.4) 

P2{y2\^2) = '^P2{y2\xi,X2)Pi{xi). (A.5) 

Xi 

Decoder 2 chooses the message that has the largest P^(y 2 l® 2 ) among the M 2 codewords. Decoder 1, 
first chooses the message that has the largest P”(^i|a; 2 ) among the M 2 codewords and then, by using Ui 
and the decoded X 2 , chooses the message that has the largest Pi{yi\xi, X 2 ) among the Mi codewords. 
Note that these decoding rules are not the optimal decoding rules (i.e., maximum-likelihood), because 
they use the conditional probabilities averaged over the random coding distributions. Let 


Pe,ij = IP{error|i,j,a;H, *21,1/1,1/2} , 


(A.6) 
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be the average probability of decoding error conditioned on the messages i and j, the codewords xu 
and X 2 j, and on and r/ 2 - Then the average probability of decoding error for (i,j) message pair is 

= XI (A.7) 

xii,x23,yi,y2 

The above conditional error event is the union of the three conditional error events, £i, £ 2 , and £ 3 , where: 
£i refers to an error in decoder 2 , £2 refers to an error in decoder 1 for decoding j, and £^3 refers to an 
error in decoder 1 for decoding i, but correctly decoding index j. Then we have 

Pe,ij <P{£i^£2^£3} (A. 8 ) 

<p{£:i} + p{£:2} + P{£:|nf3} (A.9) 

<p{£:i} + p{£:2} + P{f3l^^|}. (A. 10) 


Using Gallager’s bounding technique, we can obtain upper bounds on each of the terms at the r.h.s. of 
(A. 10), and thus obtain: 


Pe,ij < A + i? + C* 


where 


A = (M 2 - 1 )^ X (X I 

1/2 V ) 


b = {M2- ly ElE P^{x2)P^{y,\x2yP^+P^ 


i+p 


yi f X2 


\ i+p 


yi,X2 I a:i j 

Indeed, let us derive for example the bound on P{£^i}. We have: 

^ P2”(*2,i)7"2”(?/2l®2,i)P{error|ai2,i,?/2} • 


(AAl) 


(AA2) 


(AA3) 


(AA4) 


(AA5) 


i ^2,i2 

Now, define the event Ap for each i' / i, as the event that codeword ai 2 ,i' is selected, that is, 
T’ 2 "(l/ 2 l® 2 ,i') > P 2 {y 2 \x 2 ,i)- Thus, wc have: 


P {error I ® 2 , 2 , 1 / 2 } < IP S IJ 

yi'^i 

for any 0 < p < 1. From the definition of Ap, we have: 

P{Ap] = Y,P^{x2,i>) 

A' 


2' r < 


1 p 


ElP{A-) 


(AA 6 ) 


(AA7) 
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< E 


P 2 iy 2 \x 2 ,i'] 

P 2 iy 2 \x 2 ,i) 


(A. 18) 


for s > 0. Since ® 2 ,i' is a dummy variable of the summation in (A. 18), the subscript i' can be dropped 
and the bound is independent of i'. Hence, 


{error|®2,i,2/2} < (^2 - 1) Y.P2 {x2 ) 


P^{y 2 \x 2 ) 

P 2 iy 2 \x 2 ,i) 


Therefore, substituting the above in (A. 15), we obtain: 




Ms ^ ^ 

i X2,i,y2 


P 2 iy 2 \x 2 ) 

^ 2 ” (2/21 ® 2,i) 


(A. 19) 


(A.20) 


if 1 r r 

= {M2-irj^J2Yl j;/^2”(®2,*)P2”(2/2l®2,.)'-^" J]P2”(®2)P2”(2/2|a^2r • (A.21) 

2 i 1/2 X 2 ,i L X 2 

Finally, we substitute s = l/(l+p), and we note that ® 2 ,i is a dummy variable of summation, so we 


obtain: 


^2 L xi 


P{£:i} < (Ms-l)^ EE 


(A.22) 


which is (A. 12). In the same way, we can obtain (A. 13) and (A. 14). 
Returning to (A. 10), by maximizing over p we obtain: 

_ t2 — nEA(R2) _ 2~^®B(t?2) py _ 

where Ri = (log 2 Mi)/n, R 2 = {log 2 M 2 )/n, and 


Ea{R 2 ) = max^ [Eao{p) - PR 2 ] 
Eb{R2) = max^ [Ebo{p) - PR 2 ] 
EciRi) = max [Ecoip) - pRi] 

0<p<l 


in which 


EaM = -i log2 E |E ^^2”(a:2)B?(y.2k2)'''<'+'>| 

1/2 V ) 

EbAp) = -^log I j;P2”(®2)2P2"(2/l|a^2)'/('+^4 

Vi y X 2 ) 

ECoip) = ^2''(®2) I 

1 ) 2 ,X 2 I aji j 


(A.23) 


(A.24) 


(A.25) 


(A.26) 


(A.27) 


(A.28) 


(A.29) 
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Since the average probability of error P^^ij does not depend on i and j, we may write: 

p a{R2) _j_ _j_ ‘2~''aEc{Ri) 


(A. 30) 


Now, as usual, one can show in the usual way that the error exponents are positive if: 

Ri<-I{X^;Y^\X1^), (A.31) 

n 

R 2 <mm!.-I{X^;Y(^), 

I n 

where 


1 /(X 

n 


Vn' 


(A.32) 


I{X^-,Yrm 






'^P^{X2) P^{xi)P'^{y^\xi,X2)\og 

X2 331 , 2/1 


P^{y^\xi,X 2 ) 

Piiyi\x 2 ) 


Y, P2”(®2)Pr(yi|®2)log 

332,2/1 


P?{yi\x 2 ) 

P”(yi) 


Y P2ix2)P2{y2\x2)log 

332,^2 


-P2"(y2|a^2) 
PHy 2 ) ’ 


(A.33) 

(A.34) 

(A.35) 


where, again, P”(a 2 i) and ^^(* 2 ) are the random coding distributions. Note that the derivatives of 
Eao{p), pBoip)’ ^rid Ecoip), w.r.t. p, evaluated at p = 0, give the above mutual information terms. 
Therefore, we have proved that the rate-pair within the region Qbi is achievable. The proof for Qb 2 is 
similar. Combining these two regions by time-sharing, we complete the proof. 


Given the above result, we are ready to prove Theorem 2. Consider the situation where during a 


fraction A of the transmission time, the symbols of xi and X 2 form stationary Gaussian processes with 
zero mean, and Toeplitz covariance matrices = (aPi/X) ■ R^xi and R^^^ = {/ 3 P 2 /X) ■ r!^ 2 ^ with 
entries {rii,i}Y {^ 2 i,i}”ro^, respectively, where mp = r 2 i,o = 1, and , |r 2 i,il < 1 for / > 1. 
During the remaining fraction A = 1 — A of the transmission time, the symbols of xi and X 2 form again 
stationary Gaussian processes with zero mean, and Toeplitz covariance matrices R^^^ = {aPi/X)R^xi 
and R^^^ = {/3P2/X)R^X2 with entries {r’i 2 ,i}”ro^ and {r 22 ,i}o“i, respectively, where ri 2 ,o = r 22 ,o = X 
and |ri 2 ,il , \r 22 ,i\ < 1 for / > 1. Finally, note that the two input codewords satisfy the power constraints. 


-E||a2i 

n 


2 


a2A + 


(A.36) 


and similarly for the second user. Next, consider two modes of work: 


• Mode #1: receiver 1 first decodes the message of the second sender, and then uses it as side information 
for decoding his message (i.e., subtracts ^ 012*2 from the received signal y^). On the other hand, receiver 
2 directly decodes X 2 . This mode of work corresponds to the achievable rate region Qb^ in (A.2), and 
will be used here a fraction A of the transmission time with inputs that are distributed as described above. 
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• Mode #2: In the second mode (which is dual to the first mode), we refer to the mode of work which 
corresponds to the achievable rate region Qb 2 in (A.3), and assume that it is used during the remaining 
fraction A of the transmission time. We will assume here that during the second mode, the two inputs 
are distributed as described above. 

(i) (i) 

Now, given the above modes, let R\ and bn the transmission rates in mode i. Accordingly, by a 
time-sharing argument, the transmission rates of the two users are 


= A • + A • (A.37) 

(i) (i) 

Let us now calculate R\ and R^ , for i = 1,2. For i = 1, we wish to calculate the mutual information 
terms in Qbi, i-e.. 


R 

R 


( 1 ) 

1 

( 1 ) 

2 


lim 

n— >-CxD 




nX. \^nX 
5 -'I 




mm 


in / li 


lim 

l^n^oo 


nX 


n\\ 


nX 


, lim 

n—>-oo 


I{X-^;Y-^) 

nX 


(A.38) 

(A.39) 


Note that: 


I{X^^-Y{^^\X'^^) = H{Y{^^\X'^^) - H{Y^^\X'^^,X1^' 
= H{X^^ + 

= i/(X”^ + Z-^)-^log(27re). 


(A.40) 

(A.41) 

(A.42) 


Now, + Zi^) is a Gaussian random vector with zero mean and covariance matrix I + Thus 


7 nX 


(1) 


/(Xr^yl"^|X 2 -^) = ilogdet [27re(/ + i7i'^)] - log (27re) 


1 , , 

= 2 log oet 


I+ R 


( 1 ) 


Similarly, 


Y{^^) = + ,/a^X^^ + ZJ*^) - H{X]^^ + Z; 


^nX 


nX 


7nX\ 


^nX 


7nX\ 


= 2 log det 


T , bll) , bill 

I + ix^.^ + ai2Rx2 


- 2 log det 


I+ R 


( 1 ) 


and 


I{Xf-, Y^^^) = H{^,Xf + X^^ + Zr^) - + X2 


nX\ 


= ^ log det 


'l + a2iR^x!+R^^2 


- ^ log det 


I + a2iR^x! 


(A.43) 

(A.44) 

(A.45) 

(A.46) 

(A.47) 

(A.48) 


Next, we calculate the limits of these terms as n —)■ 00 . To this end, we note that due to the stationarity, 
the input covariance matrices are Toeplitz matrices, and thus we can apply Szegd’s theorem [19-22]. Let 
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eigenvalues of R''^', for i,j = 1,2. Recall the definitions in (10). Then, using Szego’s 
theorem we can show that [19, Th. 4.1]: 

n—l ^ „ 2 n 

Jim 5 ;f(p«,) = - / F(,.„H)dc (A.49) 


Jim F(pW,) = - y F(,.„(w))dc 

k=0 

for any continuous function F{-). Let us apply this result to our problem. First, note that: 

IiX^\ ynA|^nA) ^ 1 Ij ^ 


Thus, we have: 


In a similar manner: 




1 

= ^y log(l + J^ii(a;))da;. 


^(^nA. ynx^ = i log fiet [/ + ^ log det [/ + . 

1 I' I + ^ 

^2 ^ - 

k=0 \ + / 


1 / c 

5 E ‘“S ' + 7 

k=0 \ 


*- + Px^k 


Therefore: 


Similarly: 


lim . i. r ,o, 0 + d„. 


n-j-oo nX dvr Jq \ 1 + vii{uj) 


n->-oo nX dvr Jq y 1 + 


So, to conclude the results for the first mode: 


^ 

dvr 


log(l + z^ii(cj))dw, 


i ?2 = min < — log ( 1 + 


0121^21 (w) 


l + i'ii{oj)J ’dvr 


dcj, — log 1 + 


1 + 0211711 (w) 


(A.49) 


log det I + R^^^ 

(A.50) 

nX—1 

Y1 + ^Sfc)- 

k=0 

(A.51) 


(A.52) 

(A.53) 

(A.54) 

(A.55) 

(A.56) 

(A.57) 

(A.58) 
duj\. (A.59) 


For the second mode, i = 2, we wish to calculate the mutual information terms in Qb 2 - We have: 


R\ ' = min < lim 


= lim 

n—>-OD 


i nxf^Yp) 

|^rn>oo nX ’ n-;-oo nX 

I{xf^-,Yf^\xf^) 

nX ’ 


(A.60) 

(A.61) 
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where the superscript nX means that we consider the complementary block i = nA, nA + 1 ,..., n. The 
calculation of these mutual information rates is exactly the same as in the first mode. One obtains: 


= min \ ^ j ^ + 


1 


p27r 


1 + 0122^22 (<^)y ’dvr 


'''!ogfl+ 


'0 


1 + U 22 iu)) 


dw 


1 

R2 ^ 4^ y log (1 + ^22{oj)) do;. 

Thus, by time-sharing, the achievable rate region is given by: 

i?i < A • 9? [z^ii] + A • min |(^ I —^ 


7^ = U ^ (i?i,i?2) : 
0 e© 


l+ai2lA22 


.9^ 


i?2 < A • 9? [V22] + A • min jv? 




0 . 21^^12 
1 + 1^22 

l+a2iUii 



(A.62) 

(A.63) 


(A.64) 


where 0 = {a, ( 3 , A, {ri^J , {ri2,i} , {r2i,i} , {r22,i})- 


Appendix B 
Proof of Theorem 3 

For completeness, we describe the coding scheme in more detail. During a fraction A of the transmission 
time, the symbols of xi and X2 are given by: 


xi,i = PxiXi,i-i + aiWi^i-Kiaiwi^i-i, i = 1 , 2 ,. .. ,nX - 1 (B.la) 

X2,i = 9x^X2,i-i + cr2W2,i - K2cr2W2,i-i, 1 = 1 , 2 ,... ,nX - 1 (B.lb) 

where a^, for A: = 1 , 2 , is defined in ( 14 ), \pxi \ , IPxal > l^^il > l^2| < 1 , and X2,o are Gaussian random 
variables wifh zero mean and variances aPi/X and I3P2/X, and {w2,i} are i.i.d. Gaussian processes 

wifh zero mean and variances aPi/X and 13P2/X, and 0 < a,/? < 1 . That is, the symbols of xi and X2 
are distributed according to a ARMA model. During the remaining fraction A = 1 — A of the transmission 
time, the components of xi and X2 are given by: 


3^1,1 = Pxia;i,j-i + f = nA + 1 ,..., n (B.2a) 

a:^2,i = Px2X2,i-i + cr2W2,i - H 2 ( 72 W 2 ,i-i, i = nX + l,...,n, (B.2b) 


where xi^nX and xi^n\ are Gaussian random variables with zero mean and variances aPi/X and ^P2/X, 
respectively, rpi j and W2^i are i.i.d. Gaussian processes with zero mean and variances aPi/X and /SP2/A. 
Note that the two input codewords satisfy the power constraints: For the first user. 


n 


2 


aPi -aPi 


= P^ 


(B.3) 
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where we have used the fact that for an ARMA process: 


Var{xi,i} = 


aPi a‘l{l + - 2 + Kipxi) 


A 1 - a 

for i = 1, 2,..., nA — 1, and similarly for i = nA + 1,..., n. A similar argument is true also for the 
second user. 

Regarding the decoding, we consider exactly the same modes of work as in Theorem 2 (see discussion 

ii) (t) 

after (A.36)). Now, given the above modes, let R\ and be the transmission rates in mode i. 
Accordingly, hy a time-sharing argument, the transmission rates of the two users are 


+ (B-5) 

(i) (i) 

Let us now calculate R\ and R^, for i = 1,2. For i = 1, we wish to calculate the mutual information 


( 2 ) 7,(2)^ 


terms in Qbi, i-e-. 


r\^^ = lim 

n—>-cxD 


nX 


7 ,( 1 ) . ir i{xr;y2^) 

RX = mm < lim ---, hm --- 

I n—>-co nA n—>-oo nX 


We saw in (A.44), (A.46), and (A.48), that: 


^(^nA. ynAj^nA) ^ 1 ^ ^(1)J , 

I{X^Y, i log det [/ + + ai 2 i?W] - \ log det [/ + > 

I{X^Y, Y 2 ^^) = i log det [/ + a 2 ii?« + ^ log det [l + a 2 ii?W . 


(B.IO) 


Thus, we need to calculate the limits of these terms as n —)• oo. We use again Szegd’s theorem [19-22]. 
Indeed, recall that Xf and X 2 are ARMA processes. Accordingly, (B.l) can he rewritten as: 


A^xXr = <yiBnxW{ 


(B.ll) 


where 


1 0 0 




-Px^ 1 0 


(B.12) 


0 0 ... -px, 1, 
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and 


BnX = 


/ 1 0 0 

— Ki 1 0 


\ 0 0 

which are Toeplitz matrices. Thus, we have: 


... o\ 

... 0 

-Kl ij 


(B.13) 


and whence, using the fact that R^^ = {aPi/\)I, we obtain 

rW = ±El . 


(B.14) 


Xi 


^ ' (B.15) 

As before, let be the eigenvalues of R^x^. Then, using Szegd’s theorem, we can show that [19, 

Theorems 6.1 and 6.2]: 


nA—1 


Ji) ^ _ 


1 


lim ^ 

n-^-oo ZTT In 

k=0 ^ 


r27z 




(B.16) 


for any continuous function F{-), where is defined in (16). Thus, 


lim 

n—>-oo 


nA 


= log(l + 7i'^(u;))da;. 


In a similar manner. 


lim 

n—>-oo 


nA dvr 7 o V 1 ' 


1 + 7 } (w), 


and 


hm ---= / log 1 +-^ 

n^Qo nA dvr Jo \ '' ' - 


72^^ (w) 


1 + 02171 (^). 

where 72 ^^(-) is defined in (16). So, to conclude the results for the first mode: 


dw, 


^ ^ log (1 + 7 ^^ (o^)) dw, 


= min { — 
1 dvr 


1 


p27T 


log 1 + 


(Ti \ 
01272 [^) 

l + 7f^(w) 




72^^ (o^) 

1 + 0217 ^^( 0 ;), 


(B.17) 

(B.18) 

(B.19) 

(B.20) 
dwl . (B.21) 


For the second mode, i = 2, we wish to calculate the mutual information terms in Qb 2 - We have: 

flf) = I n.n ,i,„ £WA27 I, 

n^oo nX n-100 nX 


(B.22) 
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= lim 




nX 


(B.23) 


The calculation of these mutual information rates is exactly the same as in the first mode. One obtains: 


= min 7 — / log I 1 + 


1 


f*27r 




1 


f*27r 


d( 2 ) _ 

-/to - 


dvr 

V 

c 27 V 


dvr 


'0 


l + ai27f My 

log (^1 + 7 ®(a;)) dw, 


IT log 1 + 


V l+7fM/ 1 


(B.25) 


( 2 ) ( 2 ) 

where 7 } '^(•) and 72 {■) are defined in (16). To conclude, an achievable rale region is given by: 


= 


U 


a,l3,\,px^,pa:2,Kl,K,2 


(-R 1 M 2 ) : 


Ri < X ■ If 

7i'' 

-|- A • min • 


R 2 <X ■ (f 

7?'] 

-|- A • min • 




(B.26) 


Appendix C 

Proofs of Theorems 4 and 5 


Encoding: As before, we consider Iwo modes of works. During Ihe firsl A fraclion of Ihe Iransmission 
lime. Here, Ihe componenls of xi are given by: 


Xlp - T 




i = 1,2,..., nA — 1 


(C.l) 


where xi^o is a Gaussian random variable wilh zero mean and variance aPi/X, {rui,*} is i.i.d. Gaussian 
process wilh zero mean and variance aPi/X, where 0 < a < 1. We generate 2"^^^ independent codewords 
{a;i(i)} according to the above distribution. Now regarding X 2 , we use rate-splitting technique, as used 
in HK scheme, and generate 2'^^= and 2’^^^ independent codewords {^ 2 ( 1 )} and {u 2 {i)}, respectively, 
where 0 < R 2 < R 2 and R 2 = R 2 — R' 2 P'^ the following way: 


1 ^ 2 ,i — Pu2^2,i—1 T 

V2,i = Pv2V2,i-l + 



(C.2a) 

(C.2b) 


where \pu 2 \ JPual < 1’ ^ 2,0 and U 2 ,o are Gaussian random variables with zero mean and variances 
P^ 2 P 2 /X and M 2 -P 2 /A, respectively, and |ru 2 j| and j| are i.i.d. Gaussian processes with zero 
mean and variances /3^2-P2/A, and /3^2-P2/A, respectively, where 0 < /3,^2 < 1- Then, the 2"^^^ codewords 
{* 2 ( 72 )} are given by the element-wise addition: 


X2{i,j) = U2{'l)+V2{j) 

for i = 1 , 2 ,... , and j = 1 , 2 ,... , 2'^^''^, which denote the indexes of the codewords. 


(C.3) 
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During the remaining fraction A = 1 — A of the transmission time, the roles of the encoders are 
swapped. Specifically, the components of X 2 are given hy: 


X2,i — Px2^2,i—l 



i = Xn + 1,... ,n 


(C.4) 


where X 2 ,nA is a Gaussian random variable with zero mean and variance pP 2 jX, {^ 2 , 1 } is i.i.d. Gaussian 
process with zero mean and variance f3P2jX, where 0 < /3 < 1. We generate 2"^^^ independent codewords 
{a; 2 (i)} according to the above distribution. Regarding xi, we use again rate-splitting technique, and 
generate and 2*^^” independent codewords and {rii(z)}, respectively, where 0 < < Ri 

and R” = Ri — R[, in the following way: 





(C.5a) 

(C.5b) 


where \pui \ Jpvil < and vi^xn are Gaussian random variables with zero mean and variances 

a^iPi/X and a^iPi/X, respectively, and and |^ii| are i.i.d. Gaussian processes with zero 

mean and variances a^iPi/X and a,^iPi/A, respectively, where 0 < < 1. Then, the 2"^^^ codewords 

{xi{i,j)} are given by the element-wise addition: 


xi{i,j) = ui{i) -f vi{j) (C.6) 

for i = 1,2,... ,2"^^” and j = 1,2,... ,2"^^'^. Finally, note that the two input codewords satisfy the 


power constraints: 


= A^ + A 
n A 


a^iPi ^ a^iPi 


= P^ 


(C.7) 


A A 

and similarly for the second user. As described in Subsection II-B, we consider two decoding schemes 
(see, discussion after (41)). 

Analysis of Decoding #1: 

Using similar methods to analyze the probability of error, as used in Appendix A, it can be readily 
shown that under decoding strategy #1, the following is achievable during the first mode: 


R^l'^ < jim_ 


n^oo nX 


i?' < lim 

n->-co nX 

R', < lim ±I(U-Ay„A|f^„A)^ 
n->-co nX 


1 


R'’< lim —I{U^>^-Yf^\Vf^), 

n^oo nX 


(C.8a) 

(C.8b) 

(C.8c) 

(C.8d) 
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+ R'> < lim Y^>'). 

n^oo n\ 


Accordingly, for the second mode, the following is achievable: 


i?(2) < lim 

n->-co nX 


i?; < lim 

n^oo nX 

i?; < lim \l{vf^-,Yf^\uf^), 

n^oo nX 

R'l< lim -Xliuf^Yf^lvf^), 

n^oo nX 

/?|2) ^ ^ < lijn vf^] Yfy. 

n^oo nA 


(C.8e) 


(C.9a) 


(C.9b) 


(C.9c) 


(C.9d) 


(C.9e) 


Indeed, for the first mode, for example, we see that receiver 1 first decodes V 2 , and thus R 2 is hounded 
by (C.8b). Then he uses his estimate as side information to decode Xi, and thus Ri is bounded by 


(C.8a). Receiver 2, on the other hand, simultaneously decodes U 2 and V 2 , as in decoding for the MAC, 


and thus we have (C.8c)-(C.8e). Before we continue, we simplify the above regions by eliminating the 
virtual rates R'l, R", R' 2 , and R'^. We do that by applying Fourier-Motzkin algorithm [1, Appendix D]. 
For the first mode, set R^ = — R 2 , and eliminate R^ from (C.8a)-(C.8e), to obtain: 


rJ^^ < lim 

n^oo nX 

(C.lOa) 

R«-R"< lim 

n-j-oo nX 

(C.lOb) 

R«-R''< lim ^I{V2^YY2^^pnX^^ 
n-j-oo nX 

(C.lOc) 

R"< lim 

n-j-oo nX 

(C.lOd) 

rW < lini ^I{U^\V2^^-,Y2^^). 

n-j-oo nX 

(C.lOe) 

Since (C.lOa) and (C.lOe) are independent of R 2 , we ignore them. Now, collect the inequalities including 

R 2 with positive coefficients to obtain: 


R''< lim ^I{U^Y^Y2^X^ynX^^ 

n-j-oo nX 

(C.ll) 

and with negative coefficients to obtain: 


rW-R^'< lim \l{V^\Y^^), 
n^oo nX 

(C.12a) 

d? -R'i < lim \l(yd-,yd\ud)- 
n^oo nX 

(C.12b) 


Next, eliminate R 2 by adding (C.ll) to (C.12a) and (C.12b) to obtain the inequalities not including R'^'- 

rW < lim A \l{V:^^;Y^^) + I{U^^;Y:^^\V:^^)] (C.13a) 

n^oo nX L 
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< lim 


1 


/(y2"^ + liut; y2"1^2"^) 


n\. \zn\\T7-n\\ 


to ^ . 

n^oo TiA 

Thus, we obtain that for the first mode, the following is achievable: 

n^oo n\ 


< lim —- 
n^oo n\ 

R^^ < lim —- 
n^oo nX 


/(l/ 2 "^ + I{U^\ 1 T^|F 2 "^) 


41) < lim X^I(Ul^\v:^\Y^^). 
n^oo nX 

Accordingly, for the second mode, the following is achievable: 


1 


>( 2 ) 

,( 2 ) 

,( 2 ) 

?( 2 ) 


1 


< lim ^I{X^^-,Y^^\V{^^), 
n-^co nX 

RY’ < lim i 
n^oo nX 

1 


1 (^ 4 ; Y^^) + Y{^^\Vi^) 


nX, \rnX\-f rnXx 


j(ynA; ynAjf^nA^ ^ 1(17^; Y{^^\V{^^) 


R\ < lim 

n^oo nX 

RY^ < lim ^/(C/4,F4;^r^)- 
n^oo nX 


nX. \yrnX\TT-nX^ 


As before, by a time-sharing argument, the transmission rates of the two users are 

(i?i, i?2) = A • ) + A • (i?f ^, R^2^ ). 

Finally, we evaluate each of the mutual information terms in (C.14) and (C.15). Let: 

7x1 (w) = 


7ni(w) = - 

Iv^ (w) = 

- 

IvX^) - 


(1- 

-plJaPi 

A|1 

-Pxie^-|' 

(1- 

-PIYYP 2 

A|1 

-Px,e^^\^ 

(1- 

plJii^Pi 

A|1 


(1- 

plYiiaPi 

A|1 


(1- 

Pnj6/3-P2 

A|1 


(1- 

PIWP 2 

A|1 

-Pv.ei-^Y' 


As before, using Szegd’s theorem we obtain that: 


1 


lim —/(AP;y]"''|F 2 ) = ^ 
n^oo nX 


7xi 


1 + ai27M2 


(C.13b) 

(C.14a) 

(C.14b) 

(C.14c) 

(C.14d) 

(C.15a) 

(C.lSb) 

(C.15c) 

(C.15d) 

(C.16) 

(C.17a) 

(C.17b) 

(C.17c) 

(C.17d) 

(C.17e) 

(C.17f) 

(Cl 8a) 
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n->-oo nX L J [ i + 72 

lim i- \i{v:^\y:^^\u^^) + i{u^^-y^^\v:^^)] = <^ [- 

n—>-oo nX L J [ i 


(Il27v2 

+ Ixi + ai27«: 

7^2 

P 1 I 

. 1 + fl2l7a;i, 


1U2 

I + 0217x1 
7tt2 

1 + 0217x1. 


lim —I(u^\v:^^-Y:^^) = ip 
n^oo UA 


1U2 + 7f2 
1 + 0217x1. 


(Cl 8 b) 
(C.18c) 
(C.18d) 


lim ^I{xf;Yf^\vf^)=ip 
n->-co nX 


7x2 

1 + 0217,11 


lim i \l{vf^;Yf^) + I{uf^;Yf^\vf^)] = ip -^ 

n^oo nA L J [ 1 + 72 

lim \ \l{vf^;Y{^~^\uf^) + I{uf^-,Yf^\vf^)] = p - 
1^00 UA L -I 1 


0-21 Till 

1 + 7X2 + 0217«i 
7xi 

= p - 

[1 + 0127x2. 


I + Oi27x: 

lui 

1 + 0127x2. 


lim —/(cT, = P 

n^oo nX 


lui + 7xi 

1 + Oi27x2 


(C.19a) 
(C.19b) 
, (C.19c) 
(C.19d) 


Thus, to summarize our results, our new achievable rate region is given by: 


R‘"'= U 


where 


Rm = \-P 


7xi 

1 + Oi27«2 


+ A min | p 
P 


R2 < i? 2 (C) 


7ni + 7xi 7xi 

- ? - 

1 + 0127x2 J L 1 + 0127 x 

021 7xi 1 , 

- + p — 

1 + 7 x 2 + 0217«i 


7ui 

1 + Oi27x2 


7n, 

1 + 0127x2 


(C.20) 


(C.21) 


R2{^) = X-P 


7X2 

1 + 02l7ni 


+ A • min < p 


7«2 + 7x2 7x2 

- , p - 

1 +0217x1 J [1 + 0217x1 

0127x2 1 , 

- + P - 

_ 1 + 7xi + ai 27 n 2 J L1 


1U2 

1 + 0217xi 


7X2 

1 + 0217x1 


(C.22) 


Analysis of Decoding #2: 

As was done in Appendix A, we can show that under decoding strategy #2, the following is achievable 
for the first mode: 

< lim (C.23a) 

n^oo nX 

R' 2 < lim \l{Vf^;Yf^\X^^), (C.23b) 

n^oo nX 

R\^^+R 2 < lim ^I(X^^,Vf^-Yf^), (C.23c) 

n^oo nX 
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< lim 
n—>-oo riA 

R'i< lim 

n->-oo nX 

=R' + R'’ < liin ^I{U^\ 
n^oo nX 


while for the the second mode, we have: 


42) < 

n-^co nX 

R[ < lim -^liVrhYflxf), 
n-^oo nX 

f?® +i?; < lim ^I{xf,vf\Yf^), 
n^oo nX 

R'^< lim ^I{vf^-Yf^\uf)^ 
n^oo nX 

R'l< lim -\l{uf^;Yf^\vf^), 
n^oo nX 

R^^ = R' + R'l < lim vf^- Yf^). 

n^oo nX 


(C.23d) 


(C.23e) 


(C.23f) 


(C.24a) 


(C.24h) 


(C.24c) 


(C.24d) 


(C.24e) 


(C.24f) 


As can he noticed from (C.23), in the first mode, we see that now receiver 2 simultaneously (contrary 
to decoding #1) decodes Vi and X 2 , and thus R[ and R^^'^ is hounded hy (C.23a)-(C.23c). Receiver 1, 
again, simultaneously decodes Ui and Vi, and thus we have (C.23d)-(C.23f). As was done for decoding 
#1, we can simplify the above regions, hy eliminating the virtual rates R[, R'(, R' 2 , and R'^, via the 
Fourier-Motzkin algorithm. Eventually, one obtains for the first mode that the following is achievable: 


< lim —I{X?^-YR^\V^^), 
n-j-oo nX 

rW < lim 

n-j-oo nX 


< lim — \i{v^^-,Y^^\x^^) + i{u^^]y:^^\v:^^) \ , 
n-j-oo nX L J 

41 ) < lim i- [/(y4;y4|f/4) + /([/2-^y4|i/4)j, 
n-j-oo nX L J 

4 ^ 44 ^^ < lim ^ \i{x^^,v:^^;Y^^) + i{u^^-,y:^^\v:^^) 
n-)-oo n\ L 


n -^00 n\ 

4^^ < lim —r 

n-j-oo nX 


(C.25a) 


(C.25b) 


(C.25c) 


(C.25d) 


(C.25e) 


and for the second mode: 


42 ) < lim 

n-j-oo nX 

Rf^ < lim ^I{uf^,vf^-,Yf^), 

n-^oo n\ 
n-j-oo nX L 
n-j-oo nX L 


(C.26a) 


(C.26b) 


(C.26c) 


(C.26d) 


Tuesday 25* August, 2015 


DRAFT 



35 


< lim i 
n^ao nX 




nX, T^nA|T/nA\ 


Using Szego’s theorem we get that (see (C. 18) and (C. 19)): 


lim —- 

n^oo nX 


lim —- 

n—>-co nX 


I{X^^, Y{^^) + I{U^^;Y^^\V^^) 


= ^ 

= ‘f 


and 


lim ^ 

n-^co nX 


^I{xf, Vf^] Y^^) + I{uf^-,Yf^\vf^) 

Whence, we obtained the following achievable region: 


lim ^ 

n^oo nX 


= ^ 

= ‘f 


Qi27d2 
1 + Ol27n: 
7a;i Y 0,12'Xv- 
1 + ai27it2 


Q2i7t>i 
1 + fl2l7ni 
'7x2 Y Q'217'yi 
1 + 0217^1 


Y^p 


7tl2 


Y(p 


1 + 02l7a;i 

1U2 


1 + a2l7xi. 


Yp> 


7m 1 




1 + fll27a;2 
7mi 


1 + ai27x2 


7^(3) = U { 

^eH 


Ri<Ri{i) 

(i?i,i? 2 ): i? 2 <^ 2 (C) 

iil + ii2 < -Rsum(^) J 


where 


RiU) = X-ip 


'7x1 


[ 1 + 0127^2 J 


+ A min ^ ip 

Y 


lui + 7mi 

L 1 + ai27a;2 J 

Q217mi 
I + 0217^1 


,Y 


Yy 


Ivi 


1 + ai27a;2j 
7 mi 

1 + ai27x2 


Yy 


'7ui 


1 + ai27a;2 


and 


R2{^) = ~X-ip 


'7X2 

+ A min | ip 

7m2 Y 7m2 



1V2 1 

1 + a2i7Mi. 

1 + 0217xi . 

_1 + 0217x1 J 


Y 

0.\2lv2 

+ + 

7m2 


.1 + 0127m2. 

_1 + 0217x1 


Yy 



7m2 

1 + a2l7a;i 


and 


R.um{^) = X-\ip 


'7xi Y 0'12'7 v2 


1 + 0127^2 J 

+ A 


Yy 


Y 


1U2 


[1 +0217x1 J 

7^2 ~h ®217 mi 
1 + 0217111 


+ + 


7mi 


1 + ai27a;2 


(C.26e) 

(C.27a) 

(|C.27b) 

(C.28a) 

(C.28b) 

(C.29) 


(C.30) 

(C.31) 

(C.32) 
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